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ABSTRACT 

The National Assessment of Educational Progress (NAEP) is a 
survey of U.S. student knowledge and skills in different subjects at grades 
four, eight, and 12. NAEP combines samples of performances to provide 
information about the knowledge and skills of students in the United States 
as a whole, in each participating state, and in different demographic 
groupings. The report aims to increase understanding of the achievement 
levels for the National Assessment of Educational Progress: what they are, 
and what they are not. It is a reference for the U.S. public, particularly 
educators, parents, students, and policymakers. Seven booklets make up the 
report. Each booklet focuses on one of the subjects for which NAEP 
achievement levels have been set. This booklet focuses on geography. 
Information in the booklet* can be helpful in interpreting accurately the 
meaning of the geography NAEP achievement levels and student performance 
relative to the levels. Achievement levels are: basic, proficient, and 
advanced. The report explains that there are three parts to NAEP achievement 
levels: (1) descriptions; (2) cutscores; and (3) sample items. It further 

explains that the achievement level descriptions are statements of what 
students should know and be able to achieve at each level. The cutscores 
represent the minimum score required for performance at each NAEP achievement 
level and are usually reported along with the percentage of students who 
scored at or above the level. Sample items provide illustration of student 
knowledge and skills required within each level of achievement. (BT) 
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The National Assessment Governing Board 

The National Assessment Governing Board (NAGB) was created by Congress to formulate policy for the 
National Assessment of Educational Progress (NAEP). Among the Board's responsibilities are developing 
objectives and test specifications and designing the assessment methodology for NAEP. 
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Understanding Achievement 
Levels for the Geography 
National Assessment of 
Educational Progress 



Purpose of This Report 

The purpose of this report is to increase understanding of the achievement levels for the National 
Assessment of Educational Progress (NAEP): what they are, and what they are not. The report Is 
a reference for the American public, especially educators, parents, students, and policymakers. 
Seven booklets make up the report; each booklet focuses on one of the subjects for which NAEP 
achievement levels have been set. These include mathematics, science, reading, writing, civics, 
U.S. history, and geography. 

The information in this report will be helpful in interpreting accurately the meaning of the Geogro- 
phy NAEP achievement levels and student performance relative to the levels. The information will 
also aid in understanding the NAEP reports, commonly known as The Notions Report Cord. 



What Is the National Assessment of Educational Progress? 

NAEP is a survey of American students' knowledge and skills in different subjects at grades 4, 8, 
and 1 2. NAEP combines the samples of performances to provide information about the knowl- 
edge and skills of students in the nation as a whole, in each participating state, and in different 
demographic groupings. 



What Are NAEP Achievement Levels? 

Congress authorized the National Assessment Governing Board (NAGB) to set achievement 
goals for student performance on NAEP. NAGB identified and defined the goals In terms of three 
levels of achievement: Basic, Proficient, and Advanced. NAEP achievement levels define what 
students should know and be able to do at the Basic, Proficient, and Advanced levels estab- 
lished by NAGB. 

There are three parts to NAEP achievement levels: descriptions, cutscores, and sample items. 

The achievement levels descriptions are statements of what students should know and be able to 
do at each level. The cutscores represent the minimum score required for performance at each 
NAEP achievement level and are usually reported along with the percentage of students who 
scored at or above the level. Sample items provide illustrations of student knowledge and skills 
required within each level of achievement. 
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What Constitutes Basic, Proficient, and Advanced 
Achievement? 

Proficient achievement is defined by NAGB as "solid academic performance exhibiting compe- 
tency over challenging subject matter." The Basic and Advanced achievement levels are defined 
relative to this central level. Basic achievement is performance that exhibits "partial mastery over 
skills fundamental to Proficient performance," Advanced achievement exhibits superior perform- 
ance. Achievement that is less than partial mastery is referred to simply as "below Basic." 



How Good Is Good Enough? 

The overall achievement goal for American students is performance that qualifies at the Proficient 
level or higher Meeting this goal for the nation as a whole will take time. Competency over 
challenging subject matter is not easily attained. The average performance score on NAEP in 
most subjects falls within the Basic achievement level. 



How Should Achievement Levels Be Interpreted? 

Unlike most assessments, there are no individual scores on NAEP Achievement levels define per- 
formance, not students. Notice that there is no mention of "at grade level" performance in these 
achievement goals. In particular, it is important to understand clearly that the Proficient achieve- 
ment level does not refer to "at grade" performance. Nor is performance at the Proficient level 
synonymous with "proficiency" in the subject. That is, students who may be considered proficient 
in a subject, given the common usage of the term, might not satisfy the requirements for perform- 
ance at the NAEP achievement level. Further, Basic achievement is more than minimal competen- 
cy. Basic achievement is less than mastery but more than the lowest level of performance on 
NAEP. Finally, even the best students you know may not meet the requirements for Advanced 
performance on NAEP. 



How Are the Achievement Levels Developed? 

The achievement levels-setting process is carefully designed, implemented, and evaluated with 
great attention to detail and technical precision. The process of developing achievement levels 
involves the judgments of informed, well-qualified people from throughout the nation and its terri- 
tories. Approximately 30 persons serve on each of three grade-level panels to develop NAEP 
achievement levels. These 90 panelists include teachers (about 55 percent), other educators 
(about 15 percent), and members of the general public (about 30 percent). To the extent possi- 
ble, the panels are proportionally representative of the nation s population with respect to region, 
race/ethnicity, and gender. 

Panelists participate in a five-day process that includes training and instruction to prepare them 
for the standard-setting tasks. Panelists make three separate sets of judgments of student perform- 
ance on NAEP items, and they receive a variety of feedback Information about the implications 
of their judgments. Sophisticated psychometric methods are used to produce the feedback and 
guide the process. 
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Highly experienced staff and technical advisors carefully monitor the achievement levels-setting 
process. Panelists evaluate every conceivable aspect of the process, and their responses ore fully 
analyzed. Extensive analyses are conducted to determine whether panelists seemed to be mak- 
ing logical, informed judgments and whether similar panelists would moke similar judgments. 
Yet, there is no way of knowing that the standards are "right" because there is no true standard 
against which to evaluate the panelists' judgments. 



Who Sets the Achievement Levels? 

Under the law, the National Assessment Governing Board is the final authority on determining 
the levels and their use for reporting NAEP performance results. The Board reviews information 
about the process for setting the achievement levels and panelists' opinions of it. NAGB consid- 
ers the recommendations of panelists and technical advisors regarding the levels. The Board also 
considers additional information about student course-taking patterns in the subject area and stu- 
dent performance on other assessments in the subject. NAGB then judges whether the standards 
are reasonable and makes the final decisions for setting the standards. The panels for geogra- 
phy were convened in November 1994, and NAGB set the Geography NAEP Achievement 
Levels in August 1995. 
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Overview of the Framework 
for the National Assessment 
of Educational Progress in 
Geography 



This section provides a brief overview of the Geography Framework for the Notional Assessment 
of Educational Progress (NAEP) that details what is assessed by the Geography NAEP. The frame- 
work defines the structure, organization, and general content for the assessment. Many questions 
must be answered before an assessment con be developed, and answers to those questions are 
presented in the framework. 



What Is the Geography NAEP Framework? 

What constitutes geography education? Geography uses a spatial perspective to study the arrange- 
ment and interaction of people and places over Earth's space. By understanding and using a spa- 
tial perspective, students seek answers to the questions: Whot is it? Where is it? Why is it there? 
What is the significance of its location? 

The NAEP framework must delineate aspects of geography knowledge and skills to be assessed. It 
identifies different components of geography knowledge and skills to be assessed, and it indicates 
the level of emphasis that should be given to each. The framework is the guide to the assessment. 
The framework shapes the development of items and determines how student responses will be 
scored. It guides the development of descriptions of performances required for each of the NAEP 
achievement levels.’ 



How Was the Framework Developed? 

A national consensus process was used to develop the content of the framework documents for the 
Geography NAEP and the other assessments. Panels of content experts, practitioners, and profes- 
sionals in related fields developed the Geography NAEP Framework to reflect the input collected 
from groups of scholars, state and local educators, practitioners, and other interested citizens. 
The need for geographically knowledgeable citizens is both clear and widely acknowledged. 
The framework committee identified the fundamental knowledge and skills that students should 
master to be informed and productive citizens in the global economy of the 2 1 st century. 



'Fromeworb are ovallobte on the Internet ot www.nagb.org. Printed copies of the framework for Geography ond for 
other NAEP subjects ore ovoiloble from the Notlonol Assessment Governing Board. Copies ore olso ovoiloble through 
the U.S. Department of Educotion's ED Pubs Informotion center ot 1 -877-4ED-Pubs. 
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What Are the Components of the Assessment Framework? 

The general goal for the Geography NAEP is to assess how well students know, understand, 
and apply information about the three broad content areas identified for the geography assess- 
ment: space and place, environment and society, and spatial dynamics and connections. 

1 . Space and Place, This content area includes knowledge of geography as it relates to par- 
ticular places on Earth, spatial patterns on the Earth s surface, and the physical and human 
processes that shape such spatial patterns. This content area requires students to know the 
difference between human and physical forces and the differences between patterns gener- 
ated by human forces and those generated by physical forces. Students must understand 
how characteristics of both human and physical forces are spatially distributed. The knowl- 
edge and skills included in this content area serve as the foundation for knowledge and 
skills in the following two content areas. 

2. Environment and Society. This content area includes knowledge of geography as it relates 
to the interaction between the environment and society. The ways humans adopt to and mod- 
ify the environment are of continual and increasing importance. Students must understand the 
relationship between humans and their environment and be aware that outcomes of these 
interactions are subject to interpretations by different interests. Perspectives on the goals for 
the interaction of humans with their environment differ greatly, and students must consider 
various interests as they evaluate decisions about the interaction of environment and society. 

3. Spatial Dynamics and Connections, This content area refers to knowledge of geography 
as it relates to spatial connections among people, places, and regions. Geography s spatial 
perspective helps students understand the dynamics of connections among people, places, 
and regions. Connections are formed when people, ideas and beliefs, and products move 
from place to place. It is important for students to understand the dynamics of such spatial 
connections, and this requires that they understand the many factors involved. 

The framework describes four mojor topics and several subtopics for each content area. Sample 
objectives for each grade ore listed for each subtopic. The distribution of items in each content 
area is equal across the three grades assessed by NAEP. Approximately 40 percent of the items 
assess the space and place content dimension, 30 percent assess the environment and society 
content dimension, and 30 percent assess spatial dynamics and connections. 

The cognitive tasks, however, reflect differences in expectations across the three grade levels (see 
Table 1). Exercises requiring knowing ore emphasized at grode 4, and exercises requiring apply- 
ing are emphasized at grade 1 2, 

Table 1. Distribution of Exercise Pool Across Cognitive Dimension: 

Grades 4, 8, and 12 



Grade 4 
Grade 8 
Grade 12 



Knowing 

45% 

40% 

30% 



^Applying » o rongft of highororder ihinking sluUs. 



Understanding 

30% 

30% 

30% 



Applying* 

25% 

30% 

40% 
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The framework developers recommended that the assessment be structured so that students would 
spend no more than approximately 50 percent of the assessment time responding to multiple- 
choice items. The remaining time should be spent constructing responses to exercises that require 
short responses of only a few words; extended responses of one or more paragraphs; or produc- 
tion exercises that require creating maps, graphs, charts, and so forth. No more than 20 per- 
cent of the assessment time should be allocated to production exercises. The mix of item formats 
changes across grade levels; fourth graders have fewer extended response items than students at 
higher grade levels. 
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Achievement Levels: 

Descriptions and Cutscores 

Note: The performance of students on the Geography NAEP is reported on a scale of 0 to 5CX). The over- 
age score is 250 (anchored at Grade 8) with a standard deviation of 50 scale score points. 

GRADE 4 



Basic 

(187) 


Students should be able to use words or diagrams to define basic geographic 
vocabulary; identify personal behaviors and perspectives related to the environment 
and describe some environmental and cultural issues in their community; use visual 
and technological tools to access information; identify major gec^raphic features on 
mops and globes; be able to read and draw simple mops, map keys, and legends; 
demonstrate how people depend upon, use, and adapt to the environment; and 
give examples of the movement of people, goods, services, ond ideas from one 
place to another. In addition to demonstrating an understanding of how individuals 
are alike and different, they should demonstrate a knowledge of the ways people 
depend on each other. 


Proficient 

(240) 


Students should be able to use fundamental geographic knowledge and vocabulary 
to identify basic geographic patterns and processes; describe an environmental or 
cultural issue from more than one perspective; ond read and interpret information 
from visual and technological tcx>ls such as photographs, maps and globes, aerial 
photography, ond satellite images. They should be able to use number and letter 
grids to plot specific locations; understand relative location terms; and sketch simple 
mops and describe and/or draw landscapes they have observed or studied. Profi- 
cient students should be able to illustrate how people depend upon, adopt to, and 
modify the environment; describe and/or illustrate geographic aspects of a region 
using fundamental geographic vocabulary and give reasons for current human mi- 
gration; discuss the impact a location has upon cultural similarities and differences; 
and be able to demonstrate how an event in one location can have an impact upon 
another location. 


Advanced 

(276) 


Students should be able to use basic geographic knowledge and vocabulary to de- 
scribe global patterns and processes; describe ways Individuals can protect and en- 
hance environmental quality; describe how modifications to the environment may 
have a variety of consequences; explain differing perspectives that apply to local 
environmental or cultural issues; and demonstrate an understanding of forces that re- 
sult in migration, changing demographics, and boundary changes. They should be 
able to solve simple problems by applying information leorned through working with 
visual and technological tools such as aerial and other photographs, maps and 
globes, atlases, news media, and computers. They should be able to construct mod- 
els and sketch and label maps of their own state, the United States, and the world; 
use them to describe and compare differences, similarities, and potter ns of change in 
landscapes; and be able to predict the impact a change in one location can have 
on another. They should be able to analyze the ways individuals and groups interact. 
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GRADE 8 



Basic 

(242) 


Students should possess fundamental knowledge ond vocobubry of concepts relat- 
ing to patterns, relotionships, distance, direction, scale, boundary, site, and situo- 
tion; solve fundamental locational questions using latitude and longitude; interpret 
simple map scales; identify continents and their physical features, oceans, and vari- 
ous countries and cities; respond accurately to descriptive questions using informa- 
tion obtained by use of visual and technological tools such as geographic models 
and/or tronslote that informotion into words; explain differences between mops and 
globes; and find o wide range of information using on atlas or almonoc. Students 
should be able to recognize and illustrate the relationships that exist between hu- 
mans and their environments and provide evidence showing how physical hobitot 
con influence human activity. They should be able to define o region and identify its 
distinguishing chorocteristics. Finolly, they should be oble to demonstrate how the 
interaction that lakes place between and among regions is reloted to the movement 
of people, goods, services, and ideas. 


Proficienf 

(282) 


Students should possess o fundamental geographic vocabulory; understand geog- 
rophy s analyticol concepts; solve locational questions requiring integration of infor- 
mation from two or more sources, such os atlases or globes; compare information 
presented at different scales; identify a wide variety of physical and cultural features, 
and describe regional patterns. Students should be able to respond accurately to 
interpretive questions using geography's visual and technologicol tools and tronslate 
that information into patterns; identify differences in map projections and select prop- 
er projections for various purposes; and develop a cose study working with geog- 
raphy's analytical concepts. In addition, students should be oble to describe the 
physical and cultural charocteristics of places; explain how places change due to 
human activity; and explain and illustrate how the concept of regions can be used 
as a strategy for organizing and understanding Earth's surfoce. Students should be 
able to analyze and interpret dotabases and cose studies as well as use information 
from mops to describe the role that regions play in influencing trade and migrotion 
patterns and cultural and political interaction. 


Advanced 

(315) 


Students should hove a command of extensive geographic knowledge, analytical 
concepts, and vocabulary; be able to analyze spatial phenomena using a variety 
of sources with information presented at o variety of scales and show relationships 
between them; and use case studies for spatial analysis and to develop mops and 
other graphics. Students should be able to identify patterns of climate, vegetation, 
and population across Earth's surface and interpret relationships between and among 
these patterns. They should be able to use one category of o mop or aerial photo- 
graph to predict other features of o place such as vegetation bosed on climate or 
population density based on topographic features. Students should also be able 
to relate the concept of region to specific places and explain how regions chonge 
over time due to o variety of factors. They should be able to profile o region of their 
own design using geographic concepts, tools, and skills. 
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GRADE 12 



Basic 

(270) 


Students should possess a knowledge of concepts and terms commonly used in 
physical and human geography as well as skills enabling them to employ applica- 
ble units of measurement and scale when solving simple locational problems using 
mops and globes. They should be able to read maps; provide examples of plains, 
plateaus, hills, and mountains; and locate continents, major bodies of water, and 
selected countries and cities. They should be able to interpret geographic data and 
use visual and technological tools such as charts, tables, car tog rams, and graphs; 
know the nature of and be able to identify several basic types of map projections; 
understand the basic physical structure of Earth; explain and apply concepts such as 
continental drift and plate tectonics; and describe geography's analytical concepts 
using case studies. Students should have a comprehensive understanding of spatial 
relationships including the ability to recognize patterns of phenomena that exist 
across Earth, including climate regions, time zones, population distributions, avail- 
ability of resources, vegetation zones, and transportation and communication net- 
works. They should be able to develop data bases about specific places and 
provide a simple analysis of their importance. 


Proficient 

(305) 


Students should have an extensive understanding and knowledge of the concepts 
and terminology of physical and human geogrophy. They should be able to use 
geographic concepts to analyze spatial phenomena and to discuss economic, poli- 
tical, and social factors that define and interpret space. They should be able to 
do this through the interpretation of maps and other visual and technological tools, 
through the analysis of case studies, the utilization of data bases, and the selection 
of appropriate research materials. Students should be able to design their own maps 
based on descriptive data; describe the physical and cultural attributes of major 
world regions; relate the spatial distribution of population to economic and envi- 
ronmental factors; and report both historical and contemporary events within a geo- 
graphic framework using tools such as special-purpose maps and primary and 
secondary source materials. 


Advanced 

(339) 


Students should possess a comprehensive understanding of geographic knowledge 
and concepts; apply this knowledge to case studies; formulate hypotheses and test 
geographic models that demonstrate complex relationships between physical and 
human phenomena; apply a wide range of map skills; develop maps using funda- 
mental cartographic principles including translating narratives about places and 
events into graphic representations; and use other visual and technological tools to 
perform locational analysis and interpret spatial relationships. Students should also 
be able to undertake sophisticated analyses from aerial photographs or sateilite im- 
agery and other visuals. Advanced students should be able to develop criteria as- 
sessing issues relating to human spatial organization and environmental stability 
and, through research skills and the application of critical thinking strategies, Iden- 
tify alternative solutions. They should be able to compile databases from disparate 
pieces of information and from these data develop generalizations and speculations 
about outcomes when data change. 
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Achievement Levels: Sample Items 



Interpreting the Data 

Because a representative sample of students at each grade level is selected to take the NAEP, each assessment exer- 
cise is administered to a relatively small subsample of students in each grade. Typically, around 10,000 students are 
assessed in each grade, and each item is administered to just under 2,000 students. The values reported in the ta- 
bles accompanying each item are probability estimates of performance at each level of achievement for students at 
each grade level tested in NAEP. The data reported for the sample items show the probability of a correct response 
to multiple choice items and of a specific score on items requiring students to construct a response. The probabilities 
are estimates of how students scoring within each range of achievement on the NAEP score scale would perform on 
each item. These probabilities are, In fact, averages of performance within each achievement level. Some students 
who score within the Basic range of achievement, for example, will answer a specific multiple choice item correctly 
and some will not. Furthermore, student performance within the Basic range of achievement may be very near the 
lower boundary, around the middle, or very near the upper boundary, that is, approaching the Proficient level of 
achievement. The probabilities reported here are weighted averages to represent performance across the range, with 
more weight given to scores in the middle of the achievement ranges. 

Here is a suggested way to read the data for multiple choice items: "Students performing in the (Basic/Proficient/ 
Advanced) score range hove (X) probobility of answering this item correctly." 

For constructed response items, here is a suggested way to read the data: "Students performing in the (Basic/Profi- 
cient/Advanced) score range have (X) probability of giving a response scored at the indicated level (1 , 2, 3, etc.) 
for this sample item." 

Grade 4 Sample 1 — Bcisic Performance 



Describe two ways in which an increase in the use of cars can affect 
the environment. 

It can poulut the air by smoke 

going in the air 



ProbabiBty of a score of 1 



Bosic 60% 

Proficient 82% 

Advonced 94% 

2= Complete: Correctly identifies two 
effects of C05 on the environment. 

1= Portiol: Correctly identifies one 
effect of CQ5 on the environment. 
A second effect, if present, is 
incorredror trivioi for example, 
*cors help the environment since 
less people walk or ore outdoors * 

0= Inappropriate: Does not correctly 
identify ony effect of cor on the 
environment. 
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Grade 4 Sam(3le 2 — Basic Performance 




Probability of o score of 2 | 


Basic 


57% 


Proficient 


79% 


Advonced 


90% 


Scoring guide 


».* 3 ; 


2= Complete: Correctly labels all 



three features on the mop. 



1 = Partial: Correctly labels one or two 
features on the mop. 

0= Inappropriate: Does not correctly 
locate any of the three features. 



On the map above, write the names of the North Pole, the South Pole, 
and the equator in the correct location. 



Grade 4 Sample 3- Pi ovscieiit Performance 



The following question is based on the following map. 

THE WORLD 




A ship carrying cars directly from Japan to Australia travels in which 
direction? 

(X) North 

O South 

C£) East 

C£) West 



best copy AVAIUBIE 



Probability of correct response 



Basic 49% 

Proficient 87% 

Advanced 98% 
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Grade 4 Sample 4 — Proficient Performance 



1) In the box below, draw a map of an island. 

2) On the Island, put In the following details: 

- Mountains along the west coast 

- A lake In the north 

- Houses along the east coast 

- Forests In the south 

Be sure to use the symbols shown In the key below. 
Use your colored pencils to help you draw the map. 
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Key: 

MounJoin* 
loks 

666 Houses 




Probohility of q score of 3 



Basic 45% 

Proficient 68% 

Advanced 82% 




For ease of scoring, an imaginary poir 
of intersecting lines may be thought 
to run through the island in such a 
way that one line runs north to south, 
bisecting the island into eastern and 
western halves, and the other line 
runs eost to west, bisecting the island 
into northern and southern halves. 

3= Complete; Indicates all of the 
elements given bebw. 

2= Essential: Indicates three or four 
of the elements given below. 

1 = Partial: Indicotes one or two of 
the elements given below. 

0= Inappropriate: Does not include 
any of the elements given below. 

Credited Responses: 

A - the perimeter of the isbd is 
enclosed by o continuous line 
which may be smooth or jagged 
or a combination of both. 

B - mountoins to the west (left) of 
the imaginary vertical (north to 
south) line, os close to the 
western perimeter os possible. 

C - lake constructed anywhere 
within the perimeter north of 
(above) the imaginary horizon- 
tal (east to west) line. 

D - houses to the east (right) of the 
vertical (north to south) line, os 
close to the eostem perimeter 
os p(5Sible. 

E - forest constructed anywhere 
within the perimeter south 
(below) of the imaginary hori- 
zontal (east to west) line. 

Note: If the island is drawn separate- 
ly from the symbols but the symbols 
are placed correctly, a score of 2 will 
be given. 



12 



18 



'\!AbP Ai A'i“ T'/lPrsi 1 LEVELS 1992-1998 



Grade 4 Sample 5 — Advanced Performance 




Divide the imaginary continent shov/n above into three countries. The 
boundaries of these countries should follov/ the natural features of the 
continent. Use your colored pencils to draw in the country boundaries 
and then shade in the three countries in different colors. 



ProbabHity of o Kore of 2 



Basic 12% 

Proficient 36% 



that follow the noturol feotures 
of the continent and dehnes dniy 
three countries and colo5 them. 
Some ^leeway s allowed for where 
the mountain range or desert ends. 

1 = Portial: Places only one boundory 
thot correctly follows the feotures 
of the londscope, ond colors in 
the country, OR response is cor* 
reef but 0 section of load is left 
outside the 3 countries, OR re- 
sponse is correct but the countries 
ore not completely colored in. 

0= Inoppropriote: Does not correctly 
ploce ony of the boundories. 




2- Complete; Places three boundories 



Grade 4 Sample G — Advanced Performance 



WAYS TO GET RID OF WASTE 



■ Dumping far out in the ocean 

■ Burning 

■ Recycling 

■ Burying in landfills 



From the list above, select one method of getting rid of v/aste and 
identify one advantage and one disadvantage of this method. 



Method of v/aste di^osal: . Dumping far out in 
the ogeqn 

Advantage: tt* TIO Of V\/CIST& 

on land 



Disadvantage: it kills sgfi animats. 



best copy available 



Probability of a 


score of 2 


Bosic 


5% 


Proficient 


37% 


Advonced 


80% 



2 = Com^te: Describes on odvontoge 
ond disodvontoge of one method 
of waste disposol. Explonotions 
ore both specific to thot method 



1 s Portioh Oesenbes ether on odvontoge 
oro disodvontoge. A second descrip- 
tion, i present, ts incorrect or trivkil, 
m in, "'durnpirrg wQste in oceans has 
no ^ect on us,' or 'it fakes o long 
time to dump waste in oceans.' 

0= Inoppropriote: Does not occurotely 
describe on odvontoge or o disod- 
vontoge of o given method of 
waste disposol. 
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Grade 8 Sample i —Basic Perfrirmnncc 



GRAND ISIAND 




The island shown on the mop above has four cities — A, B, C, and D. 
Based only on the geographical features shown on the map, which city 
probably has the largest population? 

O A 

C£> City B 
CD City C 
CD City D 



Probabitity of correct response 



Bosic 53% 

Proficient 86% 

Advanced 98% 



Grade 8 Sample 2 — Basic Performance 




The land shown in the photograph has been altered mainly to 
(2) increase the beauty of the landscape 

increase the availability of land that can be used for farming 
® demarcate land belonging to different people 
C£) enable residents to climb the slopes more easily 



Probobility of correct response 



Basic 59% 

Proficient 75% 

Advanced 87% 



nae;p 
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Grade 8 Sample 3 — Proficient Performance 



The major areas of wheat production in the world are the central 
United States and Canada, Ukraine, south central Australia, and the 
pampas of Argentina. What is the characteristic shared by these areas 
that explains their role in wheat production? 

(2) All have rainy, damp climates. 

(X) All are near sea coasts. 

O All are plains. 

CE) All are In highland regions. 



Probability of correct 


response 


Bosic 


48% 


Proficient 


78% 


Advonced 


94% 



Grade 8 Sample 4 — Proficient Performance 



ANNUAL U.S. ENERGY 
PROOUaON AND CONSUMPTION 




*Nud«ar, Kydro«l«cfric. g«oth«nnat 

Look at the bar graph above. The graph shows United States energy 
production and consumption. 



Using this graph, compare the United States consumption (use) of oil 
with It^roduction of oil. 








ProbobiGty of o score of 2 



Basic 34% 

Proficient 75% 

Advanced 93% 




2= Complete: Exploins thot the Unit- 
ed States consumes more ail Ihon 
it produces and exploins that this 
con lead to o problem. (Accept* 
able answers for productian range 
between 15-20 and acceptable 
onswers for consumption ronge 
between 30-35. Answers outside 
this range connot be given a score 
of 2.) 

1 = Partiol: Exploins that the United 
States consumes more oil than it 
produces, or identifies o problem 
with this, but does not do both. 

0- Inoppropriote: Does not explain 
thot the United Stotes uses more 
oil than it produces nor thot this 
moy couse o problem. 



me on^roblem th 



Name one problem that this con cause for the United States. 

>Wlv- 







GEOGPAPHY 
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Grade 8 Sample 5 — Adi/anced Performance 



What are the conditions that moke the tundra difficult for human 
settlement? 



LiAMXiK tint it If u^uaII^ yghy e.»f Jl, 

tkeixx. if vehy (ittfc. vcAgiatUKj. <uJ gh.»wJ if — 






Probability of a 


score of 2 


Bosic 


7% 


Profident 


32% 


Advonced 


69% 




2- Complete: Identifies at least two 
charocterlstics of the tundra end 
moy exploln how these moke 
humon settlement difficult. 

1 =: Portial: Identifies only one chorac* 
teristic of the tundra ond moy 
exploln how this mokes humon 
settlement difficult. 

0= Inoppropriote: Does not identify 
any chorocteristics of the tundra 
nor explain how they moke 
human settlement difficult, OR 
provides inoppropriote answers. 



Grade 8 Sample G — Advanced Performance 





Drawing #1 is a better way of showing the Earth's systems than is 
drawing #2 or drawing #3. Explain why. 

<ux.. wAft feh.. <LhJ fiuv^^ tv 

<lkJ ajvl/wta^. H ^9 »J:< tk^. 



t 






<u^ Ajs.iywk,Jlj ^ 3 



best copy available 



Probability of correct response i 



Bosic 23% 

Profident 47% 

Advanced 72% 




1 ^ Correct; Explains that diagram 1 
shows that the three geosystems 
ore interdependent, OR indicates 
thot plants and animals depend 
on the other three systems (e.g., 
plonts and onimols need air to 
breathe). 

0=: Inoppropriote/Incorrect: Does not 
address the question or gives on 
inadequote response (e.g., circles 
ore interlinked, connected, rely on 
each other). 

Note: The scoring guide br this item origh 
nolly induded separate scores for inconect, 
porlioily conect, and completely correct. Af- 
ter soilng, partially correct and completely 
conect responses were combined os correct 
responses. The student response shown 
was (xiginolly scored os completely correct. 
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Grade 12 Sample 1 —Basic Performance 




On the mop above, the shaded countries represent the membership 
of the 

Organization of Petroleum Exporting Countries (OPEC) 

World Health Organization (WHO) 

North Atlantic Treaty Organization (NATO) 

British Commonwealth of Nations 



Gl;DGRAPHV 
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Grade 12 Sample 2 — Basic Performance 




H m « RaUroad Route* 

Look Q\ the mop above, which shows three possible routes for a 
railroad line that will be built to connect Red City with Bluetown. 

Which route would be the least expensive to construct? 

C 

Give two reasons why the route you chose would be the least 
expensive. 

1 y<9a.Ui!)<9MiM3b9jJ^ 



' Probability of a score of 2 



Basic 


m 


Proficient 


88% 


Advanced 


96% 




2= Camplete: Indicates that C is the 
least expensive route ta construct 
and gives tv^o reasons why, which 
may relate to A and 6. 

1 = Partial: Indicates that C is the 
leost expensive route to construct 
and gives one reoson why. 

0= Inappropriate; Indicates that A or 
B would be the least expensive 
route to construct, OR indicotes C, 
but does not give a reason why. 



0 Ifou. u^ooM <kox)e^ t®- 6 kJu 8 c( 
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Grade 12 Sample 3 — Proficient Perinrmancc 



Many people in the Caribbean region are of West African descent. 
Which of the following is the best explanation for this? 

Rapid urbanization 

O The use of slaves in plantation agriculture 
Religious persecution in the countries of origin 
C£) Economic opportunity in the Caribbean region 



Probgbility of correct response 



Basic 40% 

Proficient 81% 

Advanced 99% 



Grade 12 Sample 4 — Proficient Performance 



TRAVEITO EUROPE, 1948-1991 




What is the dominant trend shown in the graph? 

WlMe pe/spkix(Wsll-bS' Europe asiim C|®eg ^ 



1 Probability of □ 


score of 2 


Basic 


20 % 


Proficient 


56% 


Advanced 


85% 



2= Complete: Identifies the moior 



trend in the graph and provides 
two appropriate explanations. 



1 = Partial: Identifies the major trend 
in the graph but gives either na 
reason or only one reoson to 
exploin this, OR provides two 
oppropriote reasons but fails ta 
identify the trend. 



0= Inappropriate: Does not indicote 
the mojor trend shown in the 
graph, but may give one reason 
far the trend. It may just copy 
words from the groph. 



Give two major reasons for the trend shown. 

'Gmp& is eosUirij^rsjOjcL mt3 cmd pofgujgar tto/ 



BEST COPY AVAILABLE 





Grade 12 Sample 5 — Advanced Performance 



Mexico City is on example of runaway urban growth. Every day an 
estimated average of 1,700 people move there from villoges in the 
countryside. In addition, more than 1 ,000 babies are born in the city 
daily. Some geographers think that as many as 50 million people will 
live there by the year 2000. Thousands of families survive on the 
equivalent of a few dollars a day, and most members of these families 
have no prospects for steady jobs or much improvement in the physical 
quality of their lives. However, regardless of the hardship and the 
poverty, people continue to pour into Mexico City. 



Give two reasons why people continue to move to Mexico City despite 
the difficult living conditions. 







wm ©pp©ituibtt( (uictiici ajo^U/a 
oUfcUaj. 



Probobllity of a 


score of 2 


Bosic 


10% 


Proficient 


35% 


Advonced 


67% 


Scoring guide 


KPC 


2= Complete: Gives two reosons 



why people continue to move to 
Mexico City. Must convey the 
Ideo thot more opportunities, not 
guorontees, ore ovoiloble. 

1 = Portiol: Gives one reason ^ot ex- 
ploins why people continue to 
move to Mexico City. 

0= Inoppropriote: Does not give ony 
reason exploining why people 
continue to move to Mexico Gty. 



BEST COPY AVAILABLE 
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Grade 12 Sample 6 — Advanced Performance 



After we anchored our ships in the ocean and went ashore to expbre, 
we marched west. The forest was so thick we could only travel three 
miles in the first two days. Then we came to the mountains and climbed 
to the top. A rushing river flowed west out of the mountains. We contin- 
ued to march two miles west and came down out of the mountains. Two 
miles further we came to the coast. It was obvious that the area we were 
exploring was on isthmus. 

In the box below, draw a map. of the region described above. Be sure 
to include all of the geographical elements mentioned in the 
description. Include a scale to indicate distances. 




^-(©rcsfc 

— (mwjM 
/\ - (vvmtCUA 
mJa’ 




Probflhilfty of q score of 3 



Bosic 25% 

Proficient 52% 

Advanced 75% 




3= Complete: Grows on occurote mop 
in which dt leost four elements 
ore correctly ploced. The response 
must be on isthmus ond show 
direction of trovel ond river cor- 
rectly. Use of the scole is not 
necessary to get 0 3. 

2= Essentiol: Grows o mop in which 
three elements ore correctly 
ploced. The response moy be a 
peninsulo or on island. 

1 = Portiol: Grows a mop in which ot 
leost two elements ore correctly 
ploced. No answer thot gets direc- 
tion of mop wrong con get more 
thono 1. 

G= Inoppropriote: Goes not include o 
mop, OR the mop shows none of 
the elements correctly. 
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Performance Data 



Exhibit 1. 1994 Geography NAER Grade 4: 
Percentage of Students At or Above 
Each Achievement Level 



Exhibit 2. 1994 Geography NAER 
Grade 4; Percentage of Students 
Within Each Achievement Level 




Percentage 



■ Advonced SI Proficient O Basic 



2.9% Advanced 




Exhibit 3. 1994 Geography NAER Grade 8: 
Percentage of Students At or Above 
Each Achievement Level 



Exhibit 4. 1994 Geography NAER 
Grade 8: Percentage of Students 
Within Each Achievement Level 



At or 
Above 
Advanced 

At or 
Above 
Proficient 

At or 
Above 
Basic 

0 10 20 30 40 50 60 70 80 90 100 

Percentage 

n Advanced D Proficient Basic 



I 

■ 

i I 

I I 


ili! 




■ 


■■ 

m : 

t I I 




best copy available 
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NAEP ACHIEVEMENT LEVELS 1992-1998 



Exhibit 5. 1994 Geography NAER Grade 12: 
Percentage of Students At or Above 
Each Achievement Level 



Exhibit 6. 1994 Geography NAER 
Grade 12: Percentage of Students 
Within Each Achievement Level 




1 .6% Advanced 




Percentage 



H Advanced (H Proficient El Basic 



Exhibit 7. 1994 Geography NAER Grade 4: Percentage of Students At or Above 
Each Achievement Level by Race/Ethnicity 



At or 
Above I 
Advanced* ” 



At or 
Above 
Proficient 




At or 
Above 
Basic 








m 






" 








.2- - V; 

-- ... V. ... ■ . . .. .. ... 










1 ^ 
















1 1 









10 20 30 40 50 60 

Percentage 



70 



80 



90 



100 



n white n Black ® Hispanic □ Asian □ Pacific □ American Indian/ National 

Islander Aloskon Native percentage 



^Percentage of Block students who scored at or above Advanced ts 0. 1 . 
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Exhibit 8. 1994 Geography NAER Grade 8; Percentage of Students At or Above 
Each Achievement Level by Race/Ethnicity 



At or 
Above 
Advanced 



At or 
Above 
Proficient 



At or 
Above 
Basic 



0 1 0 20 30 40 50 60 70 80 90 100 

Percentage 

91 White 9 Black 9 Hispanic 0 Asian □ Pacific □ American Indian/ Notional 

Islander Alaskan Native percentage 




Exhibit 9. 1994 Geography NAER Grade 12: Percentage of Students At or Above 
Each Achievement Level by Race/Ethnicity 



At or 
Above 
Advanced* 



At or 
Above 
Proficient 




0 10 20 


30 


40 50 60 


70 80 


90 10 






Percentage 






9 White 9 Black 


(H Hispanic 


□ Asian □ Pacific 
Islander 


□ American Indian/ 
Alaskan Native 


/<' National 
percentage 



*Zero percent of American Indian/Alaskan Native students, 0. 1 percent of Black students, and 0.2 percent of Hispanic students 
scored at or above Advanced. American Indian/Alaskan Native sample size for all levels is insufficient to permit a reliable estimate. 
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